Archive for Physical and Digital Objects

ABSTRACT

Existing tools for organizing family memories offer few possibilities for easily integrating both physical and digital materials in order to produce a single archive for a family (or other group of users). This also applies to archiving of physical objects and digital media in general (even for applications outside the field of family use). An archiving system is described which incorporates at least one image capture device, a display, a sensing apparatus arranged to detect user input associated with the display, a processor and memory, and a receptacle for holding digital media storage devices such as mobile telephones, digital cameras, personal digital assistants and the like. The image capture device is operable to capture digital images of physical objects for archiving. The receptacle comprises a data transmission apparatus for automatically transferring data with the digital media storage devices and optionally also a power charging apparatus.

BACKGROUND

Groups of individuals such as families, sports teams, school housegroups, or other groups of individuals who work or collaborate with oneanother often collect a great deal of material in order to capture andpreserve group memories or for other purposes such as education andknowledge sharing. This material may be in physical form, such asprinted photographs, sports trophies, mascots, art work, birthday cards,theatre tickets etc. It may also be in digital form such as digitalphotographs and home videos. For example, there is a burgeoning amountof digital media which families capture and collect using a range ofdevices including camcorders, digital cameras, and, increasingly, mobilephones.

Existing tools for organizing family memories offer few possibilitiesfor easily integrating both physical and digital materials in order toproduce a single archive for a family (or other group of users).Furthermore, most families feel a great deal of guilt about the factthat these materials all exist in different places, and are oftencollected but never properly organized. At the same time, manyhouseholds report that, if there were a fire in the house, aside fromrescuing loved ones and pets, family memorabilia such as photos would bethe next things that would be rescued. These materials are thereforevery valuable to households and families, yet we have no good coherentsystems to allow us to easily archive and organize such family physicaland digital media in a manner that is simple to use. This also appliesto archiving of physical objects and digital media in general (even forapplications outside the field of family use).

Existing archiving systems often have complex user interfaces anddetailed systems for annotating and labeling items with key words inorder to organize the items. This leads to problems for novice users whofind it difficult to operate complex systems for archiving and accessingitems from the archive.

It will be understood that the invention is not limited toimplementations that solve any or all of the above noted disadvantages.

SUMMARY

The following presents a simplified summary of the disclosure in orderto provide a basic understanding to the reader. This summary is not anextensive overview of the disclosure and it does not identifykey/critical elements of the invention or delineate the scope of theinvention. Its sole purpose is to present some concepts disclosed hereinin a simplified form as a prelude to the more detailed description thatis presented later.

Existing tools for organizing family memories offer few possibilitiesfor easily integrating both physical and digital materials in order toproduce a single archive for a family (or other group of users). Thisalso applies to archiving of physical objects and digital media ingeneral (even for applications outside the field of family use). Anarchiving system is described which incorporates at least one imagecapture device, a display, a sensing apparatus arranged to detect userinput associated with the display, a processor and memory, and areceptacle for holding digital media storage devices such as mobiletelephones, digital cameras, personal digital assistants and the like.The image capture device is operable to capture digital images ofphysical objects for archiving. The receptacle comprises a datatransmission apparatus for automatically transferring data with thedigital media storage devices and optionally also a power chargingapparatus.

Many of the attendant features will be more readily appreciated as thesame becomes better understood by reference to the following detaileddescription considered in connection with the accompanying drawings.

DESCRIPTION OF THE DRAWINGS

The present description will be better understood from the followingdetailed description read in light of the accompanying drawings,wherein:

FIG. 1 is a schematic diagram of an example archiving system;

FIG. 2 is a schematic side view of another example archiving system;

FIG. 3 is a schematic side view of another example archiving system;

FIG. 4 is a schematic cross-section through an example archiving system;

FIG. 5 is a schematic side view of an example archiving system using adisplay having retro-reflective opto sensors;

FIG. 6 illustrates a cross-section through an exemplary touch paneldisplay;

FIG. 7 is a schematic side view of an example archiving system usingpolarizing filters at a display and a camera;

FIG. 8 is a block diagram of an example method of processing user inputat an archiving system;

FIG. 9 is a block diagram of an example method of archiving images of aphysical object at an archiving system;

FIG. 10 is a block diagram of an example method of displaying indicatorsof charging and/or synchronizing status at a display of an archivingsystem;

FIG. 11 is a block diagram of an example method of using bar codeinformation;

FIG. 12 illustrates an exemplary computing-based device in whichembodiments of an archiving system may be implemented.

Like reference numerals are used to designate like parts in theaccompanying drawings.

DETAILED DESCRIPTION

The detailed description provided below in connection with the appendeddrawings is intended as a description of the present examples and is notintended to represent the only forms in which the present example may beconstructed or utilized. The description sets forth the functions of theexample and the sequence of steps for constructing and operating theexample. However, the same or equivalent functions and sequences may beaccomplished by different examples.

Although the present examples are described and illustrated herein asbeing implemented in a family archive system, the system described isprovided as an example and not a limitation. As those skilled in the artwill appreciate, the present examples are suitable for application in avariety of different types of archives for physical objects and digitalmedia, for use by single individuals or groups of individuals who may ormay not be family groups.

The term “touch panel display” is used to refer to a surface arranged todisplay digital images electronically and where the surface is alsoarranged to detect a physical object (such as a stylus, human digit,playing piece, or tagged object such as a puck) which either makescontact with the surface or which is close to but not in actual contactwith the surface. The digital images displayed may be of any suitabletype such as video, still images, electronic drawings, graphical userinterface features, or any other type of digital images. Some examplesof touch panel displays have functionality to enable discriminationbetween events where objects come into contact with the touch panel andevents where objects merely come into close adjacency with the touchpanel.

The term “multi-touch panel display” is used to refer to a touch paneldisplay which is able to both detect two or more co-occurring physicalobjects (or parts of the same object) which either make contact with thesurface or come close to but do not make actual contact with the surfaceand discriminate between those two or more physical contacts.

An Exemplary Apparatus

FIG. 1 is a schematic diagram of an example archiving system which isprovided in the form of a table 100 with a drawer 102. For example, thetable may be for domestic use such as in a family living room. The tablehas a display 101 at the table top and a camera 103 supported on anarticulated arm so that its field of view comprises at least part of thedisplay. The table optionally has a microphone and loudspeaker embeddedor integrated into it.

The display 101 may be any suitable type of display for presentingdigital images. A non-exhaustive list of examples is: a touch paneldisplay, a multi-touch panel display, an area onto which information isprojected either using front or rear projection, a liquid crystaldisplay, a plasma screen. The display is suitable for presenting digitalimages such as videos, digital photographs, scanned documents, 3D imagesof physical objects and the like. It is also suitable for presentinggraphical user interface items such as menus, dialog boxes and the like.

In some embodiments the display 101 may be integrated into the tabletop. For example, in the case of a touch panel display, multi-touchpanel display or liquid crystal display. In other embodiments thedisplay 101 comprises the table top itself. For example, in the case offront projection such as where a micro-projector may be integrated withthe camera 103.

The archiving system also comprises a sensing apparatus, associated withthe display 101. The sensing apparatus is arranged to detect user inputto the archiving system comprising position of one or more physicalobjects on or above the display. For example, the sensing apparatus maycomprise an image capture device such as a camera positioned over tableor below table. In the case of an over table camera, camera 103 may beused as at least part of the sensing apparatus. The sensing apparatusmay also be integral with the display itself in some cases such as inthe case of a touch panel display using retro-reflective opto sensors.In some examples, the sensing apparatus is arranged to sense not onlythe position of physical objects (such as a user's hand, digit, playingpiece, puck or the like) above the screen, but is also able to detectmovement of such objects in relation to information presented on thedisplay.

The drawer 102 is sized and shaped to hold one or more digital hand-heldmedia storage devices such as mobile telephones, personal digitalassistants (PDAs), digital cameras, and the like. The drawer alsooptionally comprises a power charging apparatus (not shown in FIG. 1)which provides automatic power charging of media storage devices in thedrawer. For example, inductive pads for achieving this automated powercharging may be embedded in the drawer base and/or walls. This isdescribed in more detail below.

The drawer also comprises a data transmission apparatus arranged atleast to receive data from any media storage devices in the drawer. Thisdata transmission apparatus may operate using wired communications ormay provide physical connectionless data transmission with the mediastorage devices.

The table 100 also comprises a processor having an associated memoryboth of which may be incorporated into the table itself and not visibleto the user. For example, the processor and memory are provided using apersonal computer (PC) which may be a tablet PC. The processor comprisesa data communications link to a server or communications network. Thecamera 103 is connected to the processor such that images captured bythe camera 103 may be transferred to the processor and its memory. Thesensing apparatus is also in communication with the processor such thatoutput from the sensing apparatus may be transferred to the processor.Also, the processor is arranged to control the display.

The archiving system may be used by one or more users 105 at the sametime. Physical objects 104 such as printed photographs, printed paperitems, a child's first pair of shoes or other objects may be placed onthe display during use.

The memory of the archiving system may be used to archive digital mediaitems of any suitable type. A non-exhaustive list of examples is: musicfiles, short message service (SMS) messages, email messages, voice mailmessages, digital photographs, digital videos, text documents,ringtones, multimedia messages, web pages, calendar entries.

Exemplary Method

For example, the archiving system 100 is used to capture images of aphysical object that it is required to archive. In the example of FIG.1, physical objects 104 may be placed in the field of view of the camera103 by placing them appropriately on the display 101. The camera 103position may be adjusted by the users 105 if necessary using thearticulated arm supporting the camera. A simple user interface is usedto instruct the camera 103 to capture one or more images of the physicalobject 104. The user interface may be provided at any suitable locationsuch as in the table top, as part of the display 101, or on the cameraitself. For example, the camera may be a video camera and the userinterface may comprise a single button which when activated causes thecamera to record. This button may be a large, physical button providedto the side of the display 101. However, this is not essential. Any typeof user interface may be used. The captured images are then displayed atthe display 101 and are stored on the basis of user input received atthe sensing apparatus. In this way, images of physical objects may becaptured and stored in an archive in a simple and effective manner. Moredetail about the process of capturing the images and storing those isgiven later with reference to FIG. 8.

The archiving system 100 may also be used to capture sounds using themicrophone. For example, human speech may be recorded and stored in thearchive associated with another digital media item such as an image.This enables users to store speech, for example, explaining facts abouta physical object whose image is stored in the archive. A loudspeaker orother transducer for audio playback may be provided to enable soundrecordings stored in the archive to be played back.

The archiving system 100 is also able to receive digital media itemsthat have already been created or captured using other devices. Forexample, hand-held digital media storage devices such as mobiletelephones, personal digital assistants (PDAs), digital music storagedevices, digital cameras, and the like. These digital media storagedevices may be placed in the drawer 102 in order to enable digital datafrom those items to be uploaded onto the archiving system 100.Similarly, digital data from the archiving system may be transferred tothe hand-held digital media storage devices. For example, the drawer 102may have embedded data transmission devices which optionally alsoprovide power charging functionality. The data transmission devices andpower charging functionality are described in more detail below. Thusthe drawer 102 not only provides a safe and secure storage area forhand-held digital media storage devices, which is out of sight of smallchildren, but it also provides functionality for data synchronizationbetween those devices and the archiving system as well as (optionally)for safe, simple, and cost effective power charging.

Once a digital media storage device such as a mobile telephone is placedin the drawer, and the drawer is closed, a user may be presented with adisplay at the display 101 indicating the presence of the mobiletelephone and showing its current power charge status and datasynchronization status. Data synchronization may proceed automaticallywithout input from the user or may occur as a result of specific userinput. In the case that power charging is also provided this may alsoproceed automatically or as a result of specific user input.

Digital media items received from items in the drawer may be representedon the display, for example, as a pile of unsorted images or in anyother suitable manner. A user is then able to sort through, view andorganize those media items using the display 101 and sensing apparatus.The display and associated sensing apparatus provides a simple andintuitive user interface and in some examples is a multi-touch paneldisplay. User input at the display and associated sensing apparatus (forexample, two-handed user input) allows the triaging, editing andorganizing of the media items, be they captured images from the imagecapture device or media items uploaded from the hand-held digital mediastorage devices. The media items may be annotated for example, using astylus pen input device or in any other suitable manner. Key words maybe associated with the media items, either automatically using suitableimage processing software or by receiving user input. Album makingsoftware may be provided at the archiving system to enable users tocreate albums of digital media items using the display. The media itemsare stored at the memory incorporated in the archiving system 100 andmay be backed-up automatically to another storage location via acommunications network to which the archiving system is connected.

The display 101 and sensing apparatus may also be used to provide a userinterface which enables a user to access and display items from thearchive. For example, digital media items may be retrieved on the basisof stored time information associated with those items or on the basisof stored event information associated with those items. The interfacemay also be arranged to provide browsing of the archived digital mediaitems. The interface may provide additional functionality such asenabling items from the archive to be emailed or transferred in anysuitable manner to another location via the communications network. Itmay also be used to post items to a web site, to print items, to edititems and to carry out other operations on the media items.

Another Exemplary Apparatus

FIG. 2 is a schematic side view of another example archiving system. Adisplay 201 is provided above a drawer 202 and a personal computer 203.These items need not be integrated into a table as described withreference to FIG. 1. Rather, they may be provided in any suitable formsuch as a stand alone unit, or be integrated into a work surface. Animage capture device 200 is provided such as a camera. It is positionedsuch that its field of view comprises at least part of the display. Thearchiving system is in communication with a server 204 to enable back-upof digital media from the archive. The apparatus of FIG. 2 may be usedin a similar manner to that described above with reference to FIG. 1.

Another Exemplary Apparatus

It is not essential to use a drawer to hold the hand-held digital mediastorage devices as described above with reference to FIGS. 1 and 2.Another option is to use a bowl, tray or any other suitable receptaclewhich is sized and shaped to hold two or more hand-held digital mediastorage devices. FIG. 3 is a schematic side view of an archiving systemhaving a bowl 303 provided alongside a display 301 and arranged to holdhand-held digital media storage devices. A personal computer 302 isprovided below the display and bowl 303. Data synchronizationfunctionality, and optionally power charging functionality, may beembedded in the bowl or other receptacle in a similar manner as for thedrawer 202, 102 of the earlier examples. The apparatus of FIG. 3 may beused in a similar manner to that described above with reference to FIG.1.

More Detail about the Data Synchronization Functionality and OptionalPower Charging Functionality is Now Given

In some embodiments the receptacle comprises power charging apparatus,integral with, attached to, or embedded in the receptacle itself.However, it is not essential to provide power charging apparatus. Thepower charging apparatus is suitable for charging hand-held digitalmedia storage devices such as mobile telephones, digital cameras,personal digital assistants and the like. For example, this may comprisean inductive charging mat or apparatus such as those currentlycommercially available from Splashpower Limited™. This technologyenables a portable device to be recharged without an electrical contactand also to transmit, receive or synchronize data with another unit. Thedevice to be recharged may or may not require retrofitting of arecharging unit depending on its design. This type of technology isdescribed in detail in UK Patent Application GB 2394843, US PatentApplication US 2006/0205381 A1, US Patent Application US 2005/0116683and WO 2005/024865 A2. Inductively coupled power charging technology forpower and data transmission is also available from Fulton Innovations,LLC under the brand eCoupled technology™.

FIG. 4 is a schematic cross-section through a drawer 402 of an archivingsystem such as that of FIG. 1 or FIG. 2. A display 405 is shown abovethe drawer and a personal computer 406 is in communication with thearchiving system for back-up purposes. The drawer is optionally providedwith a shield to electro-magnetic radiation 400, 401 such as a metallayer provided around the drawer such that when the drawer is closed itforms a Faraday cage. Electronic equipment stored inside the drawer isthen protected from electrostatic discharges. Also, electro-magneticradiation from items in the drawer and from the power charging apparatusis prevented from leaking from the archiving system into theenvironment.

The base of the drawer may comprise an inductive power charging mat 407such as that described above. Similar inductive power charging apparatusmay be provided in the walls of the drawer and/or on the surface abovethe drawer.

In some embodiments antennas such as Bluetooth (trade mark) antennas 403with reduced range are attached to the inside walls of the drawer. Theseprovide means for data transmission between any hand-held digital mediastorage devices in the drawer and a personal computer 203 (FIG. 2)integrated into the archiving system. However, it is not essential touse such antennas 403 for data transmission. In cases where powercharging apparatus is provided, this may itself provide datatransmission functionality as described above.

In some embodiments the data transmission apparatus is wired such thathand-held digital media storage devices placed in the receptacle arephysically connected to the data transmission apparatus. For example,cradles for the media storage devices may be provided in the receptaclefor this purpose. USB connections may also be provided in the receptacleor any other suitable type of connections for data transmission.

In some embodiments the drawer may comprise one or more image capturedevices 404 which may be cameras of any suitable type. For example,these image capture devices 404 are used to capture images of physicalobjects placed in the drawer and which it is required to archive. Theseimage capture devices may be used instead of, or in addition to, theimage capture device 103, 200 of FIGS. 1 and 2.

In some embodiments the antennas 403 and the image capture devices 404are used to obtain information about the position and outline of anydevices in the drawer 402. This is described in more detail later withreference to FIG. 9.

In some embodiments the depth of the drawer 402 is sized relative tostandard media storage devices such that those media storage devices areforced to lie flat in the drawer in order for the drawer to close. Thispromotes increased areas of physical contact between the media storagedevices and the drawer base so that inductive charging and/or datatransmission is enhanced.

More Detail about the Display is Now Given

Any suitable type of display may be used as mentioned above. Forexample, in the case of touch panel displays, these may use resistivetouch panels in which touching the screen causes layers, which arenormally separated by a small gap, to come into contact or a capacitivetouch panel in which contact with a conductive object changes thecapacitance. Another type of touch screen technology uses opticalsensors (e.g. an optical sensor array) to detect when a screen istouched. Any of these types of touch panel may be used in the archivingsystem described herein and these are intended as a non-exhaustive listof examples.

In some embodiments the touch panel display is a multi-touch paneldisplay.

In one example a multi-touch panel display is provided as now describedwith reference to FIG. 5. The multi-touch panel 500 comprises a liquidcrystal display (LCD) having retro-reflective opto sensors embeddedbehind it. This multi-touch panel 500 is placed over a drawer 501 andpersonal computer 502 or used in any of the arrangements described abovewith reference to FIGS. 1, 2, 3 and 4. In this embodiment it is notessential to use an image capture device over the touch panel display.Instead, image capture devices may be provided in the receptacle or thetouch panel itself may be used to capture images of physical objects tobe archived.

Details about the multi-touch panel 500 are now described with referenceto FIG. 6. which illustrates a cross-section of an exemplary touch paneldisplay. A touch panel display 500 comprises a touch panel 602 that hasseveral infrared (IR) sensors 604 integrated therein. Objects above atouchable surface 606 include an object 608A that is in contact withtouchable surface 606 and an object 608B that is close to but not inactual contact with (“adjacent”) touchable surface 606. Infrared sensors604 are distributed throughout touch panel 602 parallel to touchablesurface 606. One of infrared sensors 604 may detect infrared radiationreflected from objects 608A and 608B, as indicated by arrows 610.Although the term “above” is used in this description, it should beunderstood that the orientation of the touch panel system is irrelevant.As shown in FIG. 6, touchable surface 606 is horizontal, but in adifferent embodiment generated by rotating system 500 clockwise by 90degrees, touchable surface 606 could be vertical. In that embodiment,the objects from which reflected IR radiation is detected are to theside of touchable surface 606. The term “above” is intended to beapplicable to all such orientations.

Touch panel 602 may comprise filters 612 that absorb visible light andtransmit infrared radiation and are located between touchable surface606 and IR sensors 604 in order to shield IR sensors 604 from visiblelight 614 incident on touchable surface 606 in the case where IR sensors604 are sensitive to a broader range of wavelengths of light other thanpurely infrared wavelengths.

Touch panel 602 may comprise a display that is configured to displayimages that are viewable via touchable surface 606. An eye 615 indicatesa possible direction from which the images are viewed. The display maybe, for example, an LCD, an organic light emitting diode (OLED) display,a flexible display such as electronic paper, or any other suitabledisplay in which an IR sensor can be integrated.

System 500 may comprise a backlight 616 for the display. Backlight 616may comprise at least one IR source 618 that is configured to illuminateobjects in contact with or adjacent touchable surface 606 with infraredradiation through touchable surface 606, as indicated by arrows 620. IRsensor 604 s are only sensitive to radiation incident from above, so IRradiation traveling directly from backlight 616 to IR sensor 604 s isnot detected.

The output of IR sensors 604 may be processed to identify a detectedinfrared image. The IR radiation reflected from the objects may bereflected from reflective ink patterns on the objects, metal designs onthe objects or any other suitable reflector. For example, white paperreflects IR radiation and black ink absorbs IR radiation, so aconventional bar code on a surface of an object may be detected by aninfrared-sensing device according to the described technology. Fingersare estimated to reflect about 10% of the near IR, which is sufficientto detect that a finger or hand is located at a particular location onor adjacent the touchable surface. A higher resolution of IR sensors maybe used to scan objects to do applications such as document scanning andfingerprint recognition. For example, fingerprint recognition generallyrequires a resolution of more than 200 dots per inch (dpi).

FIG. 6 provides just one example of an exemplary touch panel system. Inother examples, the backlight may not comprise any IR sources and thetouch panel may include a frontlight which comprises at least one IRsource. In such an example, the touchable surface of the system is asurface of the frontlight and not of the touch panel. The frontlight maycomprise a light guide, so that IR radiation emitted from IR sourcetravels through the light guide and is directed towards touchablesurface and any objects in contact with or adjacent to it. In othertouch panel systems, both the backlight and frontlight may comprise IRsources. In yet other touch panel systems, there is no backlight and thefrontlight comprises both IR sources and visible light sources. Infurther examples, the system may not comprise a frontlight or abacklight, but instead the IR sources may be integrated within the touchpanel. In an implementation, the touch panel may comprise an OLEDdisplay which comprises IR OLED emitters and IR-sensitive organicphotosensors (which may comprise reverse-biased OLEDs).

For some applications, it may be desirable to detect an object only ifit is in actual contact with the touchable surface of the touch panelsystem. The IR source of the touch panel system may be turned on only ifthe touchable surface is touched. Alternatively, the IR source may beturned on regardless of whether the touchable surface is touched, anddetection of whether actual contact between the touchable surface andthe object occurred is processed along with the output of the IR sensor.Actual contact between the touchable surface and the object may bedetected by any suitable means, including, for example, by a vibrationsensor or microphone coupled to the touch panel. A non-exhaustive listof examples for sensors to detect contact includes pressure-basedmechanisms, micro-machined accelerometers, piezoelectric devices,capacitive sensors, resistive sensors, inductive sensors, laservibrometers, and LED vibrometers.

IR sensors 604 may comprise suitable infrared-sensitive semiconductorelements. A non-exhaustive list of examples of semiconductor materialthat is infrared-sensitive includes polycrystalline silicon,monocrystalline silicon, microcrystalline silicon, nanocrystallinesilicon, plastic semiconductors and other non-silicon basedsemiconductors. Devices based on polycrystalline, microcrystalline,monocrystalline or nanocrystalline silicon may have better stabilitythan amorphous silicon devices. TFTs based on polycrystalline,microcrystalline, monocrystalline or nanocrystalline silicon may havehigher field mobility than amorphous silicon TFTs.

In another example a multi-touch panel display is provided as nowdescribed with reference to FIG. 7. A stylus enabled digital liquidcrystal display 704 is provided having a resistive touch overlay 703 anda polarizing filter 702 over the resistive touch overlay 703. Thedisplay 704 is positioned over a drawer 705 and a personal computer 706or used in any of the other arrangements described above with referenceto FIGS. 1 to 4. In this embodiment an image capture device such as avideo camera 700 is used having a field of view which comprises at leastpart of the display 704. The image capture device has a polarizingfilter 701 which is crossed with respect to the polarizing filter 702 atthe display.

Light emitted from the liquid crystal display passes through thepolarizing filter 702 and is thus polarized. In contrast, ambient lightin the environment is not polarized or only partially polarized.Polarized light emitted from the liquid crystal display is blocked atthe camera 700 by polarizing filter 701 which is substantially crossedwith respect to the polarizing filter at the liquid crystal display.This means that, in an image received at the camera 700, image regionscorresponding to the liquid crystal display are dark. However, imageregions corresponding to any objects between the liquid crystal displayand the camera have a higher intensity. Ambient light (from lightsources in the environment) which is reflected from any objects betweenthe liquid crystal display and the camera is captured by the camerabecause it is not polarized. Light from the liquid crystal display whichreflects or scatters from any objects between the liquid crystal displayand the camera and is received by the camera may not be substantiallypolarized as a result of the reflection or scattering process. Thislight produces an image of any objects between the liquid crystaldisplay and the camera because at least some of this unpolarized lightis able to pass through the polarizing filter 701 into the camera.

Image segmentation has thus been achieved because those regions of theimage corresponding to objects between the liquid crystal display andthe camera have a much higher intensity than those regions of the imagecorresponding to the display itself. A thresholding operation mayoptionally be carried out on the image to discard image elements with anintensity lower than a specified threshold. A feathered mask may then beapplied to smooth the edges of the remaining segmented image regions.For example, the thresholding operation and the masking operation may becarried out at the computer 706 in the archiving system.

This image segmentation process, using the polarizing filters, may beused as part of processes enabling functionality of the touch paneldisplay. It may also be used as part of processes to capture and archiveimages of physical objects.

In order to discriminate between situations in which an object, such asa user's hand, is touching the touch panel display as opposed tohovering just above the touch panel display, the resistive touch overlay703 is used. Resistive touch overlays are widely known are typicallycomposed of layers of material which when touched cause a change inelectrical current which is registered as a touch event and sent to acontroller for processing.

A user is able to operate the multi-touch panel display provided usingthe liquid crystal display, resistive touch overlay 703 and polarizingfilter 702, of FIG. 7 by placing his or her hands or digits on or justabove the display and making hand gestures and movements which may bebi-manual. The multi-touch panel display provides a user interfacewhereby such gestures and movements are used to control softwareapplications provided on a computer 706 at the archiving system. Forexample, the gestures and movements may be used to determine any one ormore of translation, rotation and zooming of a digital object. Inaddition, the user may make inputs using a stylus on the liquid crystaldisplay.

Referring to FIG. 8, one or more users make input which is sensed by thesensing apparatus. In this example of a multi-touch panel display, userinput may comprise hand gestures made on or above the touch panel (block800). Using image segmentation as described above, an image of a user'shand or hands is obtained together with images of any other physicalobjects such as pens, pieces of paper etc. that are on or above themulti-touch panel display (blocks 801 and 802). The segmented image isprocessed at the computer 706 to detect which regions in the imagecorrespond to the user's hand or hands (block 803). This is achieved inany suitable manner, for example, using stored templates of hand imagesand comparing the segmented image regions with those stored templates.

Once a hand image region has been detected, parameters describing thisregion are computed (block 804). Any suitable parameters may be usedsuch as centre of mass, principal axis and bounding area. For example,centre of mass, bounding box and principal axis of an individualconnected component can be used to respectively translate, scale androtate a virtual object.

This process is then repeated for images in a sequence (block 805)captured by the camera and differences are computed for correspondingparameters between images in the sequence (block 806). These differencevalues are then used, together with information from the resistive touchoverlay to control display of information on the touch panel display.

In other embodiments optical flow techniques are used to enabletranslation, scaling and rotation of items presented on the display viahand gestures and movements. These optical flow techniques are describedin “PlayAnywhere: A Compact Interactive Tabletop Projection-VisionSystem”, Andrew D. Wilson, ACM UIST 2005.

The process of capturing images of physical objects in order to make arecord of such physical objects for archiving is now described in moredetail with reference to FIG. 9. For example, the physical objects maybe a child's first pair of shoes, or a printed photograph.

A user places the physical object to be recorded on the display. One ormore images of that object are then captured against a background (block800). For example, the display may be arranged to present a uniformbackground color during this process or any other suitable background.Alternatively, the display may have a polarizing filter which is crossedwith respect to a polarizing filter at a camera as described above withreference to FIG. 7. The captured images of the object may include theuser's hand for example, if the user is holding that object in position.The images are captured using any suitable image capture device (orcombination of such devices) provided in the archiving system. Forexample, this may be an over table camera such as camera 103 in FIG. 1.Alternatively, the display may itself be capable of capturing one ormore images of the object. For example, a touch panel display may havescanning functionality.

The captured images are sent from the camera to a processor andassociated memory provided in the archiving system. An optional imagesegmentation process (block 901) is then carried out to segment thebackground from the image of the object. Any suitable image segmentationprocess may be used. For example, if a known background was presented onthe display, information about this known background may be used tocarry out image segmentation. Alternatively, polarization informationmay be used as described above with reference to FIG. 7.

The captured image of the object, which has optionally been segmented,may then be presented on the display as a digital imprint of the objectitself. That is, when a user removes the object from the display, thecaptured image of that object is presented in the place where the objecthad been (block 802). This provides an intuitive way in which a user isable to view the results of the image capture process.

In some embodiments, the image capture device comprises a camera havinga range sensor which enables a 3D map of the surface of an object to bedetected. Any suitable such camera may be used; a non-exhaustive list ofexamples includes those currently commercially available and thosedescribed in the following publications: “A CMOS 3D camera withmillimetric depth resolution” by Niclass et al, IEEE Custom IntegratedCircuits Conference pp 705-708 October 2004; “A time-of-flight depthsensor—system description, issues and solutions” Gokturk et al.Proceedings of the 2004 Conference on computer vision and patternrecognition workshop p35 2004. In other embodiments the image capturedevice comprises a 3D laser or infra-red scanner which enables a 3D mapof the surface of an object to be detected.

The user is then able to make input which is sensed by the sensingapparatus (block 903) in order to organize, annotate and store thecaptured image as required (block 904). A back up process may be carriedout to back up the captured image to a location remote of the archivingsystem (block 905).

As mentioned above with reference to FIG. 4 the receptacle 402 maycomprise antennas 403 and cameras 404. In some embodiments the antennas403 and the image capture devices 404 are used to obtain informationabout the position and/or outline of any devices in the drawer 402. Thisis now described in more detail with reference to FIG. 10. A position ofa media storage device in the receptacle of the archiving system isdetected (block 1000). For example, a triangulation process is carriedout using the antenna input signals in order to detect the location of amedia storage device in the receptacle. Information about thecharacteristics of the media storage device, such as information aboutits identity, power charging status, data synchronization status and soon may also be provided to the processor of the archiving system. Forexample, this information is transferred using the antennas 403 or viathe power charging mechanism.

An image of the media storage device is then displayed (block 1001) atthe display. The image may be an icon or other image representing theparticular media storage device. For example, it may be a pre-configuredimage of a particular media storage device. Alternatively, the image ofthe media storage device may comprise an outline, silhouette or otherimage of the actual media storage device as obtained from cameras 404 inthe receptacle. The position information may be used to influencelocation of the display of the image of the media storage device on thedisplay. For example, in the case that the receptacle is a drawer underthe display, the image or outline may be presented immediately above themedia storage device in the drawer. In the case that the receptacle is atray beside the touch panel display, the image may be presented in arepresentation of the tray on the display, using the positioninformation.

It is also possible for the image of the media storage device toincorporate information about the power charging status and/or datasynchronization status of that device (block 1002). For example, thisinformation may be represented using colors or any other suitablemarkers.

In some embodiments physical objects are used which have bar codesdisplayed on them. These bar codes may be of any suitable type able tostore information about the related physical object. For example, thebar codes may be simple one-dimensional bar codes that are visible tothe human eye. They may also be bar codes presented in a mannerinvisible to the human eye but which can be detected using infra redlight sources and detectors.

With reference to FIG. 11 an image of a physical object is captured asdescribed above (block 1100). A bar code in the image of the object isdetected (block 1101) using pattern recognition or other imageprocessing techniques. Information from the bar code is extracted (block1102). For example, this information may indicate the type or functionof the object, such that it is a stapler for example. Using thisextracted information the operation of the graphical user interface atthe display is then influenced (block 1103). For example, if a pile ofimages are presented on the display and the user places a stapler on thedisplay (that stapler being sensed by the sensing apparatus), this mayinitiate an action to group or attach the images in the pile together.

Exemplary Computing-Based Device

FIG. 12 illustrates various components of an exemplary computing-baseddevice 1200 which may be implemented as any form of a computing and/orelectronic device, and in which embodiments of an archiving system maybe implemented.

The computing-based device 1200 comprises one or more inputs 1201 whichare of any suitable type for receiving images captured by an imagecapture device such as a camera. The device also comprises communicationinterface 1202 which is arranged to transmit data during synchronizationof the computing-based device 1200 and one or more media storage devicessuch as mobile telephones, digital cameras, personal digital assistantsand the like.

Computing-based device 1200 also comprises one or more processors 1203which may be microprocessors, controllers or any other suitable type ofprocessors for processing computing executable instructions to controlthe operation of the device in order to provide an archiving system.Platform software comprising an operating system 1204 or any othersuitable platform software may be provided at the computing-based deviceto enable application software 1205 to be executed on the device.

The computer executable instructions may be provided using anycomputer-readable media, such as memory 1207. The memory is of anysuitable type such as random access memory (RAM), a disk storage deviceof any type such as a magnetic or optical storage device, a hard diskdrive, or a CD, DVD or other disc drive. Flash memory, EPROM or EEPROMmay also be used.

An interface 1206 is provided to a touch panel display which may be amulti-touch panel display.

An interface 1208 to a microphone and loudspeaker may optionally beprovided.

The term ‘computer’ is used herein to refer to any device withprocessing capability such that it can execute instructions. Thoseskilled in the art will realize that such processing capabilities areincorporated into many different devices and therefore the term‘computer’ includes PCs, servers, mobile telephones, personal digitalassistants and many other devices.

The methods described herein may be performed by software in machinereadable form on a storage medium. The software can be suitable forexecution on a parallel processor or a serial processor such that themethod steps may be carried out in any suitable order, orsimultaneously.

This acknowledges that software can be a valuable, separately tradablecommodity. It is intended to encompass software, which runs on orcontrols “dumb” or standard hardware, to carry out the desiredfunctions. It is also intended to encompass software which “describes”or defines the configuration of hardware, such as HDL (hardwaredescription language) software, as is used for designing silicon chips,or for configuring universal programmable chips, to carry out desiredfunctions.

Those skilled in the art will realize that storage devices utilized tostore program instructions can be distributed across a network. Forexample, a remote computer may store an example of the process describedas software. A local or terminal computer may access the remote computerand download a part or all of the software to run the program.Alternatively, the local computer may download pieces of the software asneeded, or execute some software instructions at the local terminal andsome at the remote computer (or computer network). Those skilled in theart will also realize that by utilizing conventional techniques known tothose skilled in the art that all, or a portion of the softwareinstructions may be carried out by a dedicated circuit, such as a DSP,programmable logic array, or the like.

Any range or device value given herein may be extended or alteredwithout losing the effect sought, as will be apparent to the skilledperson.

It will be understood that the benefits and advantages described abovemay relate to one embodiment or may relate to several embodiments. Itwill further be understood that reference to ‘an’ item refers to one ormore of those items.

The steps of the methods described herein may be carried out in anysuitable order, or simultaneously where appropriate. Additionally,individual blocks may be deleted from any of the methods withoutdeparting from the spirit and scope of the subject matter describedherein. Aspects of any of the examples described above may be combinedwith aspects of any of the other examples described to form furtherexamples without losing the effect sought.

It will be understood that the above description of a preferredembodiment is given by way of example only and that variousmodifications may be made by those skilled in the art. The abovespecification, examples and data provide a complete description of thestructure and use of exemplary embodiments of the invention. Althoughvarious embodiments of the invention have been described above with acertain degree of particularity, or with reference to one or moreindividual embodiments, those skilled in the art could make numerousalterations to the disclosed embodiments without departing from thespirit or scope of this invention.

1. An archiving system comprising: an image capture device arranged tocapture images of physical objects; a receptacle arranged to hold atleast one handheld digital media storage device; a data transmissiondevice, integrated in the receptacle and arranged to provide datatransmission with the handheld digital media storage device; a display;a sensing apparatus arranged to detect user input to the archivingsystem comprising position of at least one physical object in relationto the display; a processor having an associated memory, the processorbeing arranged to control operation of the archiving system and thememory being arranged to store at least captured images of physicalobjects and digital media items received from the digital media storagedevice.
 2. An archiving system as claimed in claim 1 wherein thereceptacle is a drawer.
 3. An archiving system as claimed in claim 1which is provided in the form of a table.
 4. An archiving system asclaimed in claim 1 wherein the image capture device is integral with thedisplay.
 5. An archiving system as claimed in claim 1 wherein the imagecapture device is a camera supported such that its field of viewcomprises at least part of the display.
 6. An archiving system asclaimed in claim 1 which comprises a power charging apparatus,integrated in the receptacle and arranged to provide power charging tothe handheld digital media storage device.
 7. An archiving system asclaimed in claim 1 wherein the image capture device comprises at leastone camera mounted inside the receptacle.
 8. An archiving system asclaimed in claim 1 wherein the power charging apparatus and the datatransmission device provide physical connectionless power charging anddata transmission to the handheld digital media storage device.
 9. Anarchiving system as claimed in claim 1 wherein the receptacle is adrawer arranged to form a Faraday cage when closed.
 10. An archivingsystem as claimed in claim 1 wherein the receptacle comprises one ormore location sensors to sense location of objects in the receptacle.11. An archiving system as claimed in claim 1 wherein the display is atouch panel display.
 12. An archiving system as claimed in claim 1wherein the display is a multi-touch panel display.
 13. An archivingsystem as claimed in claim 1 wherein the display comprises a firstpolarizing filter overlay and the image capture device comprises asecond polarizing filter overlay having a polarization substantiallycrossed with respect to the first polarizing filter overlay.
 14. Anarchiving system as claimed in claim 1 wherein the display comprises aresistive touch overlay.
 15. An archiving system comprising: a table; animage capture device arranged to capture images of physical objects; adrawer in the table arranged to hold at least one handheld digital mediastorage device; a data transmission device, integrated in the drawer andarranged to provide data transmission with the handheld digital mediastorage device; a display integrated into a surface of the table; asensing apparatus arranged to detect user input to the archiving systemcomprising position of at least one physical object in relation to thedisplay; a processor having an associated memory, the processor beingarranged to control operation of the archiving system and the memorybeing arranged to store at least captured images of physical objects anddigital media items received from the digital media storage device, boththe processor and the memory being integrated into the table.
 16. Anarchiving system as claimed in claim 15 wherein the image capture deviceis supported over the surface of the table into which the display isintegrated.
 17. An archiving system as claimed in claim 15 wherein theimage capture device is integrated with the display.
 18. An archivingsystem as claimed in claim 15 which comprises a power chargingapparatus, integrated into the drawer and arranged to provide powercharging to the handheld digital media storage device.
 19. An archivingsystem comprising: an image capture device arranged to capture images ofphysical objects and having a first polarizing filter; a receptaclearranged to hold at least one handheld digital media storage device; adata transmission device, integrated in the receptacle and arranged toprovide data transmission with the handheld digital media storagedevice; a display having a second polarizing filter substantiallycrossed with respect to the first polarizing filter; a sensing apparatusarranged to detect user input to the archiving system comprisingposition of at least one physical object in relation to the display; aprocessor having an associated memory, the processor being arranged tocontrol operation of the archiving system and the memory being arrangedto store at least captured images of physical objects and digital mediaitems received from the digital media storage device.
 20. An archivingsystem as claimed in claim 19 wherein the display is a touch paneldisplay.